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ABSTRACT 

The Pennsylvania Plan, a statewide edu::ational 
quality assessment program, first formulated ten educational goals to 
serve as bases of evaluation and program development. Two of the 
plants three phases have been completed. Phaf.e I involved organizing 
a Bureau of Quality Assessment to establish a working evaluation 
plan, including the development of neasurement instruments and 
procedures for collecting data, hypotheses concerning pupil 
achievement, and computer analytic techniques. Phase II was designed 
to provide patterns ot student performance on each ot the ten 
educational goals, reconfirm hypotheses concerning the relationships 
between pupil achievements and school and community variables, and, 
based on these relationships, provide regression weights for use in 
subsequent phases, and establish the adequacy ot the measuring 
instruments. Phase III is characterized by tour analysis and 
reporting procedures: prediction ot expect'iid school means, comparison 
of school neanSr comfaLison of student distributions, and evaluation 
ot student responses to key items* This data should enable school 
personnel to use tools and techniques developed in Phases I and 

II. See also TW OOU 60U-612. (PR) 
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The Pennsylvania Plan 
For The Assessment of 
Educational Quality 




Legislation 

Quality assessment in Pennsylvania Jiad its beginning in Section 290.1 
of Act 299, August 8, 1963. Tire act required tJie Stale Board cf 
Education 

lo develop or cause lo be developed an evaluation procedure derigned to 
measure objectively the adequacy and effiiicncy of the educational programs 
offered by the public schools of the Commonwealth, The evaluation pro- 
cedure to bt developed shall include tctts measuring the achincments and 
performance 1 1 students pursuing all of the \arious subjects ar d courses 
comprising the •'urricula. The evaluation procedure shall be so constructed 
and de> eloped as lo provide each school district with relevant compar>itive 
data to enable directors and administrators lo more readily appraise the edu- 
cational performance and lo effectuate without delay the strengthening of 
the dislrirl'ft eduratiocal program. Tests developed under the authority of 
this section to be administered lo pupils shall be used for the purpose of pro- 
viding a uniform evaluation of each school district and the other purposes 
set forth in this subdivision. The Stale Hoard of Education shall devise 
performance standards upon completion of the evaluation procedure required 
by this section. 



Ten Goals of Quality Education 

To carry oiil these mandalce, llic Slate Board of Education appointed 
from its members a conimitlcc on quality education. 1 "c conmiitlce, 
after mccling willi civic and professional leaders from ihrotigliout the 
stale, adopted, in March, 1965, the following Ten Goals of Quality Edvi* 
cation to fcrvc a? the |ja*i? for n?#o?^mcot and asi the basis for the de- 
velopment of program?: 

1.1 
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I. Qualify education should kelp exery child acquire the great- 
est possible understanding of himself and an appreciation 
of his tiorthiness as a member of society. 

H. Qualify education should help every child acquire under- 
standing and appreciation of persons belonging to social y 
cultural and ethnic groups different from his onn. 

111. Quality edit cat ion should help every child acquire to the fuli 
est extent possible for iiiniy mastery of the basic skills in the 
use of words and numbers. 

JV. Quality education should help every child acquire a pod the 
attitude toward the teaming process. 

V* Quality education should help every child acquire the habits 
and altitudes associated with resfyonsiblc citizenship. 

VL Quality education should help every child acquire good 
henlth habits nnd an understanding of the conditions neces- 
sary for the maitilaining of ])hy steal nnd emotional well- 
being. 

VII. Quality eiliication should give every child opportunity and 
encouragement to be creative i/i one or more fields of en- 
deavor. 

VIII. Quality education should help every child und^'r stand the 
opportunities open to him for preparing himself {or a pro- 
ductive life and should cnnblc hhn to lake full advantage 
of these opportunities. 

IX. Quality education should help every child to understand 
nnd appreciate ni niueh as he can of human achievement 
in the natural scienrCSy the social sciences, the hunumitie^ 
and the arts. 

X. Qualify ediwation should help every c/nld to prepare for v 
world of rapid change and wxjoreseeable demands in which 
ronfinnin^ education t^'.roughout his adult life .should he a 
normal expectation. 



Phase 1 of ihe Pennsylvania Plan 

The Uiircavi of K<Iucalional Quality Assc^^wonX was organized in 
June 1967» to translate the mandate^ of the act and the widwn of llir 
Slate Board of Education into a worViri . plan of assL,>nicnt. 



Given the ten poaU of quality education and tlie mandate to develop 
performance standard* based on these goaVs ibe liiireaii’s first task was 
to determine the extent to which students in the eommonwealth arc 
fulfilling tlie retfuirenients of these coals. Through Phase I of the 
assessment plan, four major objectives were met: 

Mkasurfaiint J\siklime\ts For Each Of The Ten Goals Were 
Developed, Pilot Tested And Kveined. 

Measurement was given first priority by the bureau, F'or some 
goals, standc^dized published tests were found adequate. For other 
goals where no items were found ade<juale, the bureau staff, together 
with staff from the Bureau of Rescareli, developed and pilot trste<l 
items. 

By April 1968, a rncasiirrmenl package was iea<ly and was adminis- 
tered to 5tli graders and Illh gra Icrr in 100 schools throughout the 
state. Usable data was ohtaimd frcin lil3 5th graders and 1285 lltli 
graders. 

pROCEDl RtS I "or CoU EClING DaTA A BOUT ScHOOL Am) CoMMUMl V 
CO.NDITIONS ERE DEVELOPED, Pi LOT TeSTED AnD KeHNED. 

Pupil achievements inns! be considered in light of surrounding con- 
dition?. 71ie assessment model takes into consideration those factors 
the pupil brings with liiin, tliose jiarlinilar comlition? the surrounding 
community offers him and those sehoed cfiaraclerl^tics which a.fccl liini. 
Some of tills inlormalion was eolleeled from state records hut most of 
the inforinalioii was furnislie<l by school adniinislraiors. fearber> and 
pupils. 

Hypotheses Coxcermnc Pupil Achikvemems And Those: School 
And CoMMi NiTY Conditions Aefectinc AcmE\i>tEMs Were Tested 

And ANALY.JED. 

It is in the aualy.^is of the data where infererire? are to.sied .nnd the 
adeijuacy am< i fficieney of mcasuremenl items arc analyzed. Kacli o^ 
the variables was analyzed lliruugh the use of correlational tcchniqiu ‘ 
and regrc.uion analysis. Kacli of the items was scrutinized with item 
analysis techniques. 

Computer Analytic Techniques Were De\vi.ophv Tried Ovt And 
Kefined. 

Nothing succeeils as well a? real data to test the adequacy of statis- 
tical formulas and the efficiency of computer prograiiis. Ihc Plu .«e 1 
data proviiled the o| (lortmiity to select from tne many analytic lech* 
niquos those ino.«l applicable for comparison and prciliclion of s:hool 
means. 
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Pha?c I finding? indiralr lliat liio?e faclors which pupi!^ firing wilfi 
llicin — levels of previous learniii" and cdacalional anfl occiipational 
levels of parents — aio most dgnifieaiil in rlelerniining how well juipils 
aeliieve. Tfiese findings arc neilficr startling nor revealing. The more 
eonsequential findings arc ifiat lliesc pu[iil faetors do not aecoiinl for 
all of the differences in jiupil achieveiiients. In fact, in many of tfie 
goafi, less tliaii half of tlie differcnecs in pupil acliievemcnls is accniintcd 
for hy sorioeconomic and jinttntial ability factors. Tfie implications 
are that sc?iools can and do make a difference. 

Phase i Findln^s^ pnblisfied in Oefeniher 19fi8, contains extensive 
information about the measuring procedures* tfie measuring instruments, 
tile distributions of [>upil scores and the relationships between pupil 
acbievcfucnts and school and eomiminily ebaraetrristies. 

Phase II of the Petmsylvania Plan 

Tile asse.'siucnt of etlucatioiial quality imisl fie irauslaled into a prac- 
tical working tool in or<lcr to fie useful to school ilistriels in appraising 
and strengifiening their educational programs. I'basc H was de. 
signed to: 

1, Provide patterns of student performance on each of the ten 
goals. 

2. Reconfirm liypotbeses eoneeri.iug the relationsiiijv between pu- 
I>i! acliievcments ami seltoo! am! eomnninity variables. 

?. Based on these relationsliij)?, provide rcgrc-slon wcigiits for use 
in subsequent phases. 

1 Kslafilish the adequacy of the moa>uriug instruments. 

Snhsecjueni sections of Phase // ViadUi^is r ontairi exte nsive infoi illa- 
tion resulting from the eollectioiv ami analysis of the l*fia-e U date. 

Phase in of tfie Peimsylvaiiia Plan 

Phase in of tfie Peuns\(vania Plan is ediiealional quality assessment 
in action. Beginning in tfi<‘ Kail of 1970, selioo) (>rrsOMiicl will he able 
to use the loi, ^ and Icehniques developed in Phase I and Phase 11 to 
as«ess die ailerjuacy ami efheieney of their programs. Asse-ssiiu nl will he 
in leriiis of student pcrforiiiaiiret with difTerenres among iiidividuah, 
schools and communities taken into account. 

.Analysis and a form of reporting are so iiiterlorked that one largely 
determine? the other. Four analysis and reporting jiroredurcs will eiiai- 
acterito Phase III: 
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pRFDicTioN Of Expfctfd School AIfans 



Tlie fir?il step in tlic analysis of tlie Pliase llf daU ^vlll lie J > predict 
wliat the average pupil performance will he for jmpils in a parli< iilar 
school cn each of the ten izoals. 

Co^tPARLsoN Ok School Means 

Tlie next st«*p will he the eompari^io/i of the ]>redj( l» d h ><d mean 
w ith the actual school mean. Statistical tests for the a u of rlif- 

fererees will he ajijdied. 

COMPARtSON Of StI dent DiSTRIBI TIONS 

The actual rlistrihution of individual stmlciit scores in percentage 
\ ihics will he roLipared to the ]>redicted distrihution of indivirlual stu» 
dent scores. Statistical tests for the sigriiriraiiec of diderenccs will he 
aiJplied. 

Evaia ATioN Of Sit DEM Hfsponsfs To Kev Items 

.Any preoiction model empirically derived depends for its eoenii icuts 
tpon the eu/rcnl status of activity in the field. The pos>ih3lily always 
exists that studeiits may fe achieving exactly as they are predietcf) to 
achieve on tin* basis of the conditions under wliieh lliey operate, while 
their aeliievemeols are far from satisfactory in terms of thoughtful and 
serious value jiidgii'eiits of seliooh cominimity and slate d( pai tment per* 
sornel. llieTefore, an examination will he made of tlie j>roporlion 
of ^llldents pci forming at levels judged to he imaecej>tahle in light of 
more ideal eritrria for each of the ten goals. Proportional frerpieiicies of 
resjionses will he given for ki y items for ''a^'li goal. 

W hen a school j>artieij>ates in Phase III. schoed personnel ran: 

1. Examine diserepaiioies lictweeii expected ineaii stmlcnl per* 
forniance anrl actual mean stuu'Uit perfornia; re. 

2. Examine diserepaiieies hciWt'eri no/malive «li?*trdHMions of 
student performance and actual d istrlhiitione of iiidivifliial 
perrormance. 

3. Examine the proportion of student* who fali in the und»>ii 
able re*pon;e category on several key itiiri*. 

W here seriou* nrgalive iliscrcpaiicies e\i«t hetwern pr«'elicted and 
actual student achievement, school |)ersonm l together with l)i juirtim nt 
of Education personnel will he able to work together to morlify jvrograni* 
in an atleinpi to c'rrrrt the di‘cre[*atiry. 
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Wlicro nrtiia! acliicvciiK'ni a^rrc^ willi [)rcflirlcjl acliievcnirnU parents, 
tcarliers an»1 i?tu*lrnU may frcl to remain in the expected out- 

put category in wliicli they fuuJ llieniselvoA. KiTort?: may llieii be de- 
signed to move perforjuarirc beyond the limitation.i suggested liy Uie 
cornlilion variables. 

Where a sig,nifieaiU number of students res])oiid unsatisfactorily to 
key ilf-rns, ]>rogram niotlifiea'ions may be directed loKar<l providing stu- 
dents with the opportunity to <leveloj) more satisfactorily. 

Finally, where jliscreiuincies arc positive, Deparlrnent of Ediiealion 
personnel and selionl personnel will aseertain wbal ajtpear to be the most 
eoniribuliiig factors so tliat tbe^c positive prartlecs eari )>e sjiarc<! v.itli 
other schools tlimiigboiil the state. 
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